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ABSTRACT - . 

The third year of an individualized multimedia 

bilingual magnet school project for limited English prof icient 

students in Philadelphia was evaluated. Bilingual multimedia learning 
centers were bperatied at each of the two sites. At the elementary 
site, pupils from Korean, Spanish, and Portuguese backgrounds 
received bilirigu^l instruction and were provided with materials for 
individual arid small group instruction. At the secondary site, ^ 
computer-aided instruction was offered in addition to other bilirigual 
iristructiori to students of Chinese^ French, Italian^ Kbreari^ Spanish, 
arid Vietnamese speaking backgrounds^ English cbmpreherisiori arid 
reading skillswere accelerated by participation iri the prbDect, 
while English speaking skills progressed at a rate comparable to that 
of similar students city-wi.de . ,Iri addition, attendance and student 
retention objectives were met. (Author/RW) 
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EXECUTIVE SUMMARY 



An Indlvl-dual izedMul tf-media BTHngual Education Magnet Model served 
llmlted-Engl ish-prbflclency' pupils from a variety of 1 Ingulstic backgrounds. At 
the elementary slte^ pupils whose mother tongue Is Korean, Spanish, or Portuguese 
participated In bil Ihgual instruct Idh^. At the secondary site, pupils whose 

mother tongue Is Chinese (MSndarIn or Cantohese) , French, Uallan^ Korean, 

Spanish, or Vietnamese were In bi 1 ingoal instruction. Instruct Ion in Engl [sh 
for speakers of other languages was provided for all pupils who were not proficient 
In English regardless of mother tongue. A Bilingual Multi-media tearnlng Center 
(BjMLC) was operated at each site. This center contained a wide variety of 
materials for individual and small-group Instruction of pupils. At the secondary ; 
site, the BIMLC contained terminals used for computer aided and managed Instruction. 

This report is devoted to evaluation of the thirds and final, year of^fitle VII 
funding. Academic performance was evaluated using experimental designs that 
employed _esti mates of pupil achievement in the absence of the program which were 
derived from the regress ibh of test scbriss on pupil character i sties. Where 
appropriate, a comparison of project students with an estimate derived from the 
city-wide Title I ESOL project evaluation was also used. Secondar^^U pupM 
attendance and pupil retention goals and enabUng objectives were evaluated by 
comparing program outcomes to criteria developed by project management. 

WitR\the exception of development of Informal reading inventories in the 
first languages of pupils, all enabl ing object Ives were attained or considered 
attained. Program participants' English comprehension skills and English reading 
skills were accelerated by the project. English cbmprehehs Ibh ikills grew at a 

faster rate than those bf equivalent students In the city-wlde ESOL program^ . 

During 1978-1979* evaluation of Engl ish speaking ski 1 Is was problematical becau^ 
pupil mobility resulted In a srtial 1 sample of students, but there was a trend 
that was similar tb bne observed the pr:evious year— pupIl^s grew at about the 
same rate as equivalent pupils in the city-wide ESOL program. Attendance and 
pupil retention goals were attained. 



INTRODUCTION 



BlUngual-biculturai programs are usually designed tbmeet Instructional 
demands which arise when a school population Is composed of two groups^ native 
English speakers and speakers of one other [anguage. When there are more than 
two groups, billnguaj education Is often avoided because the number of subgroups 
consisting of pupils sharing a common_f f rst language, a cbmmbn Jevel of experience 
with English, aRd a common age or grade level becomes Inordinately large. The 
Individualized Rultl-medfa Bilingual Education Magnet Model program Is an attempt 
to deal with tSIs diversity In a cost-effective way. 

RATIONALE 

Bi 1 ingual-blcuj tural programs are Intended to provide support to limited 
English-speaking ability pujxlls through use of EngUsh and the home language for 
ihstructlbh. The Individual ized Multi-media Bilingual Education Magnet Model 
program was designed to explore the feasibility of providing bl 1 Ingual -bicul tural 
instruction in a settjng serving seVeral Unguage groups. To accomplish this 
goal, the Bl lingual Individualized Multt -media Learning Center (BIMLC) concept 
was developed and impUmented at twosites: Blrney Elementary School and South 
Philadelphia High Schools At the elementary schck) l a btllhgual program was 
available In Spanish, Portuguese^ and Korean. At the secondary site a bilingual 
program was a vallable in Spahlshi French^ Italian, Vietnamese^ Chinese (Mandarin 

and CantoneseJ, and Korean. At both sites, pupl Is who spoke other languages 

also participated. These pupils made use ^ f Engl Ish to Speakers of Other Languages 
(ESOL) curriculum and relevant materials he jsed In thf B[MLC^ As some teachers 
are mul ti-1 IhguaU mahy members of the smaller linguistic groups received Informal 
assistance through their mother tongue when needed. Tutoring supplemented the 
classroom instruction of some students. 

£XgECTED-OOTCQMES 

Pupils are expected to make a smooth trans? tlph from instruction In their 
home language and ESOL to mainstream Ihstructlbh at the school . In the course 
of making the transition, cpmpetence in the home language Is to be enhanced or 
retained, and growth in academic skill areas is to be maintained. As the BIMLC 
provides Instructional resources which supplement ESOL, acquisition of English 
should be facilitated. 



At the secondary level, the use of the mother tongue and flexibility in 
course rosterlng is expected to result In good attendance and more students 
remaining in school until graduation. 

PREVIOUS FINDINGS 

After two and one hglf years of bperation, all pupil performance objectives _ 
were attained or considered attained. The rate of acquisition of aural comprehension 
competence exceeded the rate found among pupils of the comparison group — pupils 
in the Title 1 ESOL program. 
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Pupils In the programacqulred speaking skills at the same rate as those In: 

the comparison group, English reading scores Increased at a faster rate than ^ 

predicted from test-publ fsher's hdrms. Elementary school Hispanic pup M s equal led 
or exceeded Spanish reading test norms for rural Puerto Rico. Secondary school 
HI span I c pupl 1 s ' average score was equ I val ent to the 36th percen 1 1 1 e oF Puerto 
Rlcan tenth grade norms. Object Ives regarding high school pupils' completion of 
the school year and attendance were attained. 

During 1977-1978 new s.tudents were admitted to the secondary site program 
every few days, and 42% of the pupils on roll at year end were not on roll 
during the first ten days of school. 



PROGRAM IMPLEMENTATION 

Some aspects of program Implementation were stated as enabl Ing object Ives . 
These aspects will be discussed jn- the next section, Atta 
Other aspects of program Implementation will be discussed In this section. 

Project management successfully Incorporated nearly al 1 program elements at 
the two sites, an elementary school and a very large high school. 

Elementary Level : The Birney Elementary School program served pupils in 
grades kindergarten through four. (hb fifth and sixth grade pupils attend the 
school)^ .The baste instruct ibhal pattern was unchanged from that of the previous 
year. The majority of the pupils In the program spent part of the instructional 
day studying in Engl ish-jariguage mainstream qlasses, studying ESOL In both 
classroom and Bi 1 ingual Instruct ional Mult I -med]a Learning Center sett ings, and 
studying in classes which teach language arts and other subjects in the home 
language. During monitoring vis|ts made In the spring of 1979, the program site 
coordinator reported that 121 pupMs v/ere being servfed. This was 23% more than , 
the number of pupils being served durtng the same period the previous year. 

Korean pupils were the largest language group in the program (51 pupils). 
This group was fol lowed by speakers of Spanish (3-^ pupils) and Portuguese (14 

pupils). In addition to the three major language groups of the elementary 

program there were 22 children who were speakers of other languages: 13 Laotian 
pupils, five Vietnamese pupils, two Guianese pupils, ^i Majaysiap pupil, and a 
Pakistani pupil. According to the site coordinator, these children studied 
English as a second language and received Instructional reinforcement in the 
BIMLC. 

0- 

A modification in the elementary program was ao increase in the number of 
hours of English Instruct ion that '^Beginning'' ESOL level pupils received during 
the school day. _ During thefirst half of theschobl year^ these pupils received 
one and one half hours of ESOL instruction daily in either a classroom or In the 
BIMLC. This was increased to two and one quarter hours during the second half 
of the school year. The increase In service was made possible by assignmg a 
teacher who had previously had responsibility for both the center and classes to 

the BIMLC full time. To accomplish this, an additional ESOL teacher, who also 

spoke Spanish, was assigned to the program, and the bImLC was irioved to a classroom 
space which could accommodate more pupils than was possible in the space used 
previously. 



During the past two years the principal the site coordinator , and the 
teachers 6T the elementary programwbrked oh and completed a new report card 
format suitable for a mul t i-l Ingual bllihgual program. It has sections In 
English, Korean^ Spanish and_Pprtuguese which explain the mearvlng of the Informatl 
the teachers record oh It. This report card was used during the spring of 1979. 

In cbncluiloh, the elementary site program has continued to^ 
Hispanic, and Portuguese pupils with the services descrfbed In the proposal . ^ _ 
Because of an Increasing number_of^pup[ls who speak other_lahguages, ah addltlbhal 
staff member and larger quarters for the BlMte have been provided. If the 
majortty of tbe new arrlvaU continue to be of one national I ty, Laotian , project 
management might explore adding an Instructional component In their home language 
and adding the language to the newly developed report card. 

Secohda ry Lev.e 1 : The program cbhducted at South Philadelphia High School, 
continued to provide bi 1 Ihgual Ihstruct Ibh ih seven lahguages, Spanish, Frsnch, 
Italian, Vietnamese^ Chinese (Hahdarlh and Cantonese), and Korean, Pupils who 
spoke other languages (e.g. ^ Arabic, Greek, Ladtlan) participated In the English 
Instructlbh ahd the mul ti-cul tural activities of the program. 

Use of a BIMLC was part of the Engl ish_[nstruct ion. The site cobrdinatbr 
developed a schedule which gave each ESOt teacher access to the center durlhg 
specif ic_per|ods each week* Based on teachers ' diagnoses of pupi Is ' heeds, 
members of the ESOt cUsses were sent to the BmLC. There they were able to do 
the Individualized work that had been prescribed by the teacher ahd communicated 
to the aide who managed the center. 

Largely due to evehts Ih South-East Asia, the secondary site program^ 

experienced a large ihcrease ih the humber of pupl 1 s . An add i t Iona[ bilingual 
(Engl ish-Spahlsh) teacher of English for Speakers of Other Languages was added 
to the program staffs and a Chinese-speaking graduate student served as an aide 
during the spring. As the Increase In student population occurred during the 
year. It was necessary to conduct classes In the library and, during some periods 
of the school day. In the* BiMLC. 

The evaluators had an opportunity to observe that "the studehts of different 
groups could work well together when they attended a celebratibh of the Oriental 
New Year. The celebrat ionwas "stretched'Vtb Include sbhgs ahd dances of both 
Oriental and Occidental cultures, ahd ended with dancing to rock and roll music. 

During February, 1978, there were school-systsn wide increases th teaching 
persphhel mandated by labor agreements.^ At the secondary level, one outcome of 
the ihcrease was that students were permrtted to rearrange their course rosters. 
Some secondary-schoo[ program students used this event to drop or change program 
classes. As a result of this action on the part of the students^ the data 
analyses for Product Objective 2 had ta be modified, and the number of pupils , 
tested for part of Product Objective 1 fell below that considered reasonable by 
evaluators. . 



In conclusion^ the secondary level program operated fh a manner consistent 
with the Intent ofthe proposal. The Influx of hew South-east Asian students 
was accommodated with addltlbhai staff, but the necessary InstrucCional spaces 
could only be obtained by making . compromises • The mid-year revision of all 
secondary student rosters resulted in attrition of the secondary-level pupils 
who were tested. 

ATTrAiNMENT OF OBJEeTIVES 

OB^eciive I. During 1978-1979^ .pvogTom sia^^ ajDhtinue io identify evaluate ^ 

cmd puTofidse inBtTmciiditdt rrHzieriats and equipment for the Bilingual Individualized 
Multi-media Learning Center* This will include: 

. Adquiaition of appropriate grade level instinidtional materials for teaching 
reading and other srXb^ects in each of the languages of the program. 

. Reproduction arid delivery of of f-line materials needed for the computer- 
managed and corrputer-assisted instruction at the secondary school site. 

. Acquisition of other prograrmed instx*uaiionai materials. 

This objective wasattained. Evaluators reviewed the materials which had 
been acquired and ordered during the fall of 1978 with Division of Foreign 
Languages staffs. Evaluators saw a new System 80 unit, hew film strlps, new 
tapesin English, and a varietyof InstructTonal aids whichcouldbe usedwith 
existing hardware when they visited the elementary BIHLC. A hew System 80 unit, 
hew film strips, ahd hew Lahguage Usage Skills cassettes were purchased for the - 
secondary school BIMLC. 

]n addition to the new acqulsltrons noted above, site coordinators reported, . 
and monitorjng visiti confirmed, that equipment purchased during the previous 
years was on hand and In use. Consumable materials (workbooks , Voxcom cards, 
and off-line materials for use in computer-based ihstructloh) were available^ 
when evaluators visited the sites. 

Although the primary function of the BIMLC is the teaching of English, the 
center at the secbhdary site had a substantial ambuht of written materials ih 
the first languages of piupils served by the program. 

The evaluation of the seconds-year reported that teachers at the elementarv' 
site were not using the Voxcom because of the complexity of the planning required. 
This problem has been solved, and evaluators saw the Voxcom being used frequently. 

Xhe sescbhd year evaluation also raised questibhs abbut the Inclusion of_ 
computer-aided and cbmputer-mahaged ihstruct |bh at the secondarysi te. Not all 
al 1 _ issues- related to the computer based Ihstruction were resolved. __During the 
early mbhths of the prbgram, f re^quent equipment malfunctions were feportedi 
Throughbut the year, pupils had to be reminded to ^'slgn off" when endmg a 
period bf computer use. Fai lure to sign off prevented the pupiVs_work with the 
computer to register properly. In lateMay, the aide serving the BiML 
interrogated" the computer record keeping system to determine the amount oftlme 
each pupil in the program had used it, but the Information obtained was valid 
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for only some puptlsi Registered usage ranged from 0 to 15 hours during the^ 
year, but this under-est Imates the true ambuht of use. The aide reported that a 
few students used the computer bfteh^ but many others felt Intfmldated by the 
equipment. ^. 

Four computer programs were available, a readjng program^' a cons^ 
educatlbh program^ a career Information program, and' a mu[tt-topIc prpgram 
dealing with 13 areas such as games, -mathematics^ chemistry ^ social science^ 
business arid lariguage arts. The_aide reported that the readlng prograim, the 
mathematics component of the mult t-toptc program, the career Information program 
and, the games component of the multl-toptc program'were the ones most frequeritly 
used by students. 

In conc"tusion, at the end of three years of Title Vl^.l furidtrig, all goais 
stated In this objective havc^ been attained^ but eValuators bel leve that , due to 
equipment and record keeping problems^ the vaj-Ue of computer based Instruction 
" at the secondary level has riot beeri demonstrated. ' , 

Objective 2. A Teavutiment progrmt ijitl te_ao7^iis^d by pm^eai sr^ffy distviat 
stcperintendenf s^ prinaipats of the tuo sites j cmd -^ Of fiae of Informational 
Services that will attract non-English domirmnt Spanish^ Portuguese^ Korean^ 
Chinease^ Vietnamese^ Ital-Um^ and spedJcing pupils who live outside the 

regular boundaries of the project schools^ thue creating the rrnignet progr^. 
This program will begin in Auguaty 137S and contimm ifarough Dec^er^ 1978. 
It will include: 

• News releasee sent to newspapers seizing each of the language groins. 

• ArtnouYiBemenis oh radrib prbgrdms serving speakers of the language of 
the program. 

. Pupil recruitment by members of the program^ s parent advisory group. 

. Notification to all pririaipdls of elementary and secondary schools 
describing the programs arid asking them to identify students who can 
benefit-^ from them* 

this objective was attained.-^ School personnel reported activities similar 
to those used durlngthefirst two years of the project. The secondary level 
program drew students from areas outside the regular school boundaries. The 
elementary program served pupils who resided in the multi-ethnic neighborhood 
surrounding the schobU 

J5ite coordinators of bbth the elemeritary arid secbridary programs reported , 

that they used thee I ty-wide screen! rig procedures to identify project participants 
As this wasthe third year of bperatidri, the program was known to prlnc|pa1s_of • 
bther schbbis. The coord triatdrs reported that art tcles_about the program appeared 
in the schools and in the Hispanic and Astag press^_ The project was described 
on the local Spanish-language radio station. Project coordinators from both 
schools reported e5Ctensrye_contact_with the other schools and with^ 

community organizations serving Immtgrant populations, especial ly National i ties 
Service Center. Contacts established during previous years with other service 
organ izat Ions » Catholic Social Service Agency^ Lutheran Children and Family 
Services, and Jewish Family Services, were reported to have been maintained. 



Flye|^ In six languages were disseminated In tfie various ethnic ccmimuri 1 1 i es 
serv^ by) the secondary level program, - These were placed In shops mefcharidtzing 
goodsS4>rected to the target ethnic groups • The secondary level program was 
also described In 1 1 teratar& prepared by the Foreign Language Magnet f^chbbl 
program of the cl.tyi 

At the elementary level ^, teachers engaged In activities which resulted in a 
high degree of personal contact. Teachers ahd-the site coordinator reportgd 
making visits to homes.; They also reported meeting with neighborhood church 
groups which cater to 'the heeds of the ethnic groups to be served. 

As was the case during the first two years of the program, the outcome was 
not the same at ^the two school sites. At the elonentary si te^ the pupl Is tended 
to reside close_ to the school. In the past the principal of the elementary 

school stated that the existence of many elementary schefols with ESOL and 

bilingual programs reduced the probability that parents would send their children 
to a school outside the neighborhood. Atthe secpndslte^ many program students 
came from outside the usual feeder area of the school. 

Obseative 3. _ 'Progfrm_8taff spe^^ Chinese^ ItatuzHy Poi*tugue3ej Viep^ese, 
Korean^ and Frendh willy with the assistanae of supeiPvisovB and 
personneij, develop inforrml redding inventories to be iised i^ 

to evatudte mther'-tongue reading perfoTm<zna^^ speaking these languages • 

These inventories witt be prepared by Jime^ tS7S. 

- - -_ This object lye was not attained because staff ^time was used In ways which ^ 
had higher priorities. History materials for use with Chinese^ Vietnamese^ and 
; Korean secondary students were prepared, A multi-lingual report card was 
.designed for the jelemehtary level program^ and a booklet of useful English 
expressions wa^ prepared for parents. 

A common reason appears to underlie the failure to attain this objective 

durfngthe three years of the project: the heed to develop appropriate instructional 
tools In languages other than English and Spanish. |n each year, development of 
these materials has taken precedence over the development of informal reading 
inventories. : . ^ . 

' Cbieaiive 4. Monitoring T^lt show that staff and students Jaj^_ fcorrlliar with the - , 
use of the individualized materials and equipment in the BIMLC. 

This objective was considered attained. Students and staff appeared_to be 
familiar with the use of all equipment during monitoring. As discussed earl ier 
in this report, computer maintained records suggested that secondary, level 
students either did hot use the computer equipment properly or used it Itifr^ 
r.uehtlyi During the late spring, when a sharp Increase In the number of South-east 
Asian pupils made classroom space scarce, the secondary site BIHLC was used as a 
classroom for half the school day. 

Observation of the use of the BiMbC at both the elementary and._ secondary 
sites indicated that the hoh-comp^ basedequipment was used regularly. At the 
secondary site the students worked with individual ized Instruct Ibhal material s 
' in two ways. During some periods^ teachers brought the ESOL class they were 
teaching to the center; during other periods^, teachers- sent _ students to work in 
the. center with materials thfey had prescribed. The BIMLC aide would obtain the 
materials and assist the students jh their use. Students were observed working 
In small groups or by thanselves i^hen they were Iri the BIMLC. 

.10 
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At_ the elementary level all pupils In an ESOL class were scheduled to work ' % 
in the BIMLC at the same time. An ESOL teacher and the BIMtC aldf were^resenT^ - - 
when pupils were work I n§ In the cenl^er. In addltIon,.an/_ESOl^tea^c : 
served as a resource special jst, was present In/^t^^ the second . ^ 

half^of the school year. Small groups were observed workjng with one' of the 
adults In the room. While these^group activities were conducted, Individuals ^ 
worked with Systems 8d ond Voxcbcn type teaching equlpmenti ' ' ' 



Product Objectives - - 

■ - - - > .. 

_lZ. The rate dfiacqp^isition of Engli^ speaking and corr^rehenHdn ski^ of 
pupids meas^ ESOL Screenirig TMst 'and ihe Test of Aural ' 

Cornprehensidn (TAC) will be increased ^to GCisignificant degree (p<.05).<:- 

^ This objective was attained for English ^csriprehens Ion skills. The number - 
of pupils whose scores could* be >analyzed (35 pupils) was too small for a fair 
evaluation of speaking skills. 

Analysis of Test bf Aural Gorifprehens Ion (Tfte) Tscores that there was 

a statist ically s Igo I f leant relationship between mon In the prog raTn and 
mastery of English comprehension^ The felat ipiTshlp was curvilinear, meaning . 
pupils learned to comprehend English quickly upon, entry into the program^ wfjfh 
the rate of learning (as measured by the TAC) decreasing the longer the Pupil _ _ 
was In it. There was also evidence that the rate bf growth of .pupl Is com- 
prehensibh of English in_thls program exceeded^he 'rate bf growth of pupils In 
the city-wide Title 1 ESOL prbgram. \ 



To evaluate aural comprehension, high school pupils were dlvj^ded at^random 
into three groups, elementary school papilf ^1Y'^®^?^_''?"^9"^ l*^.?^? ^fotips. 

TAG tests were administered every_ few weeks throughout the spring, according to 
a schedule which prescribed testing at the secondary site, then the elementary 
site, then the secondary s4te, etc. In this mariner^ evaluators attempted to 
vary participants' exposure to^ the program at the time they were tested. 

Tbevaluate the effect of the program oh TAC perfbrmance, i multiple 
regressibh analysis was cwnpMted which explained 61% bf the variance Jri scores. 
The results areshbwn in Table 1. Test Form, Birthplace, Sex^ linear and', 
curvilinear effects bf Grade,, the effect of moving from one scho'bl to another 
during the year, (School Continuity) an^ length of residence In the United 
States mainland (Mainland Residence) were control 1^ ^^^^istlcal ly In order to_^ 
obtain a measure of the effect of the program_on ^pupi 1 s_which was not -confounded 
by these variables; As can be seen in the table,' only one bf the control variables, 
Grade, was statistical ly significantly related to TAC scores once the other 
variables were taken into account. 

The effect of pupils'' exposure to, the program was statistically significant. 
Twb sighificaht regression wilghts^ 1.15 fbr MbrithS in the Prbgrarri and, -0.02 
fbr Square bf Mbhths In the Prbgram describe a^curvninear growth pattern. 
During the first few months in the program pupl Is' scores Increased rapidly. 
The longer a pupi 1 was In the pVogram^- the slower the_rate_of_ increase. the_ 
r?9r®?? ^P*^.??? Wsi Sy^suggests that, after 29 months_the program would. In theo^ 
have no_effect on tne typical papills_acquisition of the English comprehension 
sk! 1 Is measured by the TAC. As this program has been funded for three schobl 
years (30 months), and was not Implemented fully during the fall of the First'' 
year^ the regression analysis suggests' that pupils learned ski 1 Is measured by 
the TAC during the entire period they were exposed to the prbgram. 
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Because the TAC was also used fn the city-wide T]t1 e l ESOh proXe^^^^ 
possible to cdrripare the comprehenslon growth rate found in the Title I ESOL 
project to the growth rate fpund in this progranii In the evaluatlbri of the 
Title I program, a regression analysis similar to tHe one Just described was 
computed. In the Title I ^Valuation no first grade pupils were. tested^ and a 
variable to control for differences between public and parochial schools was 
Included.: A comparison was made between the regression weights bfthe 
Individualized Hulti-media Magnet Model program and the carrespdndi fig regression 
weights 6f*^the Title f ESOL program. The differences between the regression 
welahts were cbmpahed tothe standarderrbrs of thelc dl fferences. The regression 
weights reflecting the effects of pupil background characteristics were similar _ 
in both programs. In contrast, the linear and curvi linear effects of part iclpatl^ 
in the programs differed by two or more standard deviations. ^The Unear e 
of Months in* the Title V] j program was larger, j-s that, upon entering 

it* pupils^ aural comprehension grew faster than in Tltl^ ESOt. The curvili- 
near effect was alsostronger, suggesting that^^^ventual 1y Title I ESOL participants' 
aural comprehension growth wou|d catch up to the growth found in- the Individualized 
Multi-media Magnet Model projects 

• Speaking skills were to be- evaluated by havirig_prpgram.site cpordmators 
and teach*ers administer the two speaking portipnsjpf the Philadelphia £SOL 
Screening Test a few weeks after pupill_tpbk the TAC test. A. 33 t sample of 
students reported to be on roll when TAC testing was conducted were to be tested. 
While this happened at the elementary school site, fewerpupilswere tested at 
the secondary site than was anticipated because some students transferred to_^ 
mainstream Engl isH? classes around mid-year. The info 

the scores of niany_ remaining secondary leve| students was not avfa 11 able because 
theywere newlyadmitted. As a result, speaking test scores of only 35 pMpils 
could be analyzed. Agression models^ similar to the one used to evaluate aural 
comprehension" were 'tbmpu ted. Bl rthpl ace, Sex^ 1 inear and curvi 1 Ineaf' effects of 
Grade, c6ntinuity_of attendance at one* school (School Continuity) and length of 
residence In the Shited States ma Inland (Main lan^^ were used' to control 

for pupil background. Months, In *he Program and th^ of Months in the 

program were the variables which reflected the effect of the program on achievement- 
Two analyses Were cdmputed, one for each of the' speaking test scores. 

f \ _ : _ V , : , _ 

The set of predictor variables Ineach analysts explained substantial 
portions of the varfabi j Fty Fn^the scores (^5^ of the variance of the first 
speaking test score, 5k% of th.e variance of the second speaking, test score) . 
However*, none of the regression lwi:lg^ measuring prbgram 

r impact were statistical ly sl^ftW^a^^^^^ different from ^ero on the first measur 
of Speak! rf§ and only BirthplaVei'^nci Years of Residence in the United States 
mainliaria were s igrflf Icahi^/ dlS^f^r^^^ (p<.05) on the second. Althbugh they 

were riot statistically sign ifjirant^ -the sizes arid directions of the weights of 
the va.rlables>ref lecilrig prp^ralh parti cj pat i^^^^^ were similar to those of 
cprresporirflrig analyses in the.Title j ESOL program. 

• _ ' \ \^ , ' . 

In mammary, tb I s_year*s ^valuation of mastery of^ English aural ^comprehension 
skills confirms the^previous finding^ that the I ndlvldual Ized Mul t l-medla, Bl 1 Ingual 
Magnet ModeL accelerates tjie rate that* pup! 1 s learn this skJll. In* contrast^ 
the firidlrig of previous- years, that speaking ski 1 1 s were enhanced Ijy -tfhe prbgram ^ _ 
to the same degree as_ in tlie Title I ESOL program, was riot cbriflnned. The combination 
of a cbmplicated sampling design, secondary students' changing their rosters. 



the Iriflux of students at the secondary level, and the resulting Igw number of 
pupils whose scores could be analyzed were probably the reasons for previous 
years' frridings not being replicated. 

2. The rate of acqutsiti^ of 
Stanford Achievement Teet^ will inoreaBe Bignificantty among picpits in grade t 
and above. 

Thj^s objebtlve was consldered attained^ As pupil history data coHected 
during the administration of the TAG cests were tJeeded for the reading-test 
analyses and there was a hfgli fate of pupil mbbi 1 1 ty, only about half the program 
participants' scores could be analyzed. Separate analyses of fall and spring 
tests were carried out when the fall data could hot be used to calculate an 
estimate of the spring scbresr Tfie .analyses showed that part IcI pat Ion In „ 
the program was statistical ly significantly related to reading achievement. 

fw> sets of regression models were computed, one reflectlngthe lmpact_of 
the program on students as of November, 1978, the other reflecting the jmpact of 
the prdgram as of April , 1979. Each set showed stat 1st ^ (p;^05 or 

better) Improvement In scale scores attributable to program participation on>the 
three reading-related subtests of the Stanford Achievement Tests, 

■ , , _ . i; . . . 

During the fall , Form A of the test was used. During theysprlng^ Form B 
was used. Primary Level 1 was used at the elementary school^ arid Iritermedlate 
Level 1 was used at the secondary school. A program evaluatbr cbriducted the 
testing. 

fable 2 shows the analyses of the November tests, which reflect the effect 
of the prograro bri pupils through November, 1978^ test these 

pupils could have been in the program for up to twenty-three months. As pupils 
had been admitted continuously throughout the program^s period of existence, the 
majority of those tested cWere in the program for shorter periods of time. 

the three analyses (Word Study Skills, Reading, Vocabulary) each explairi at 
least 6d^ of the varlatlbri In scale scores arid have regression weights showing 

that the control variables {Birthplace^ Sex^ Grade^ Schbbl Coritlriui ty, and 

Mainland Residence) had •simi lar effects bri the three reading measures. Birthplace 

arid Grade variables had effects which were statist ically significantly (p<^b5) 

related tb perfbrrtiarice bri all three tests. There were^^al so statist I c:a11y significant 
rel at ibriships 'between Vocabulary, score and Sex and School _eont|nu|ty; and between 
the Reading subtest score and Ma[niand Residence, When background variabless 
were controlled statistically, program exposure was significantly related to 
Word Study Skills, Reading and Vocabulary scores. The 1 inear trends were all_ 
significant (p<.d§ or better) and positive. Upon eoterlrig the prog ram ^ Word Study 
Skills scores rose at an estimated rate x>f 3.26 scale score units per mbrith^ 
Reading scores rose 1.8Q urilts per months arid Vocabulary scbres rose 1,57 un|ts 
per month as a result of program part Id pat i bri, THe variable S.quare bf Months In 

the Pro§ram_ref lects charige Iri the fates* bf learrilrig with Increased program 

expbsure. The statistically sigrilficarit smal 1 negative weight for thIsvaHable 
iri the regression eqUitlbn for Word Study Skills arid the non-s|gn If leant negative 
weights iri the equatibris for Reading and Vocabulary suggest that the rates of 
acquisition of reading- related skills may not he linear. 



tibli 3 sfibws the results of testing students In the Spring with an alternate 
foTO 8f the reading test. WHlle the percent 'of variance explained by e^ch 
regression analysis dropped slightly, and fewer pup. 1 background _yariables were 
Statistical ly significant, the results of the spring testing confirm those of 
the fall. The accomplishments of pupils attributable to_^the program were measured 
id a statistically significant degree (p<.05) • §galn, there was evidence that 
the rate of mastery of reading- related skills may not be linear. 



Evaluators originally planned to use the pretest Scores to predict posttest 
scores. In so doing, they would have used the pretest regression equations to^ 
predict the socre a pupil would have attained at the^tlme of the posttest If the 
pupil had not participated in the program during 1978-79. However, evaluators_ 
found that a key variable. Mainland Besidence, had negative^ rather than positive 
regression weights. Examination of correlation matrices suggested It was a 
supressSr variable. If the fal 1 ^ findings had been used to predict spring scores, 
findings would have been misleading. 

The analyses presented do not differentiate between the study^of -Engl tsh in 
the Individualized Multi-media BiUngual program and study of English in the 
city-wide ESOL program. The reader should be aware that the analyses reflect the 
"cumul^ti-ye effects of pupil participation In both programs . Earl ler in this report 
the evaluators noted problems of pupH^obi 1 1 ty at the secondary level. As a resul 
of these problems, secondary level pupils are ";i'l«|;:'-^P'-f '",'J"f ."""'^"^ 

Evaluatbr^ believe that secondary pupils with the highest levels of English. 
rSding c^petence are the ones who were most ' '"f '^^°.''°°?ruc?ion°in thl 
ihstrultion in the bilingual program in favor ^^J"?' If .'^^5, 
mainstream of the school. For this reason, secondary^ pupils 'f'^J,^'^^^^ 
levels of English' competence were probably under- represented In the analysis or 
the posttest scores. 

meoiive 3: \t least 75% of the tOih gpade pup-its and M of fteim ^ l2th 
|aS p^pifa bolted in^ th/progvam by October, 1978 wUt complete the school 
ybar. 

This Objective was attained. Pupil retention was greater than ^85?, the 
more stringent criterion stated .in the objective. As was P'"'°^.- 
years, rnany secondary level pupils were not assigned to ^ grade, making grade 
dependent criteria inappropriate for evaluation of this aspect of the program. 

Ninety-three program pupils were on roll 'ifi the secondary^school program 
according to the October Pupil Directory computer file.^ One of these pupi s 
transferred to a non-public school. Of the remaining ?2 pupils, four pupils 
dropped out of school, for a retention rate of 96%, which is above the 85% 
criterion. i 

in the course of deteTOihlng pupil retention, evaluators found that 17 
pupils , in the group graduated from high school by the end of the year. 

mcectvoe 4: Secondary level pupils seized by the^ toue cm c^^^ 

rate no greater than that of other pupils in the same,, grade enrolled vn~the same 



This objective was attained. Secbhdarv school prbfrarti pupils' attendance 
was Well above the attendance of other pupils at the school. As was the case 
With Performance Objective 3> a grade-dependent analysis was hot made because of 
the large number of ungraded pupils in the program, 

A total of 241 pupils participated in, or were admitted to, the secondary 

school program during the course of the year and had retrievable attendance 
records. These pupils were present an average of 8G.1% of the days they were on 
role. This compared to Sk.U% for the school as a wholei 

- J - - - - - . . _ _ ^ . 

In order to make the cbmparlsoh of pupils iri the program with pupils of the 
school a fair pne^ seven pupils who enrolled but never attended were Included on 
the program role. The Division of Administrative and Survey Research reported 
that pupils who registered^ but heyiar attended school ^ Were included In the 
school-wide data they provided. ' If the pupils who were oh role but never attended 
the program were el imihated from thie couht, the average daily attendahce of 
participants would have been 80.6^. 

Attendance of program participants also compared favorably with city-wide 

'^'9'^ ^^bP^L?^^?*^^?^^?* Tb^.^Yf??® attendance In all high schools was 7^-3^, 5-7 
percentage points below the program rate. 

SUMMARY AND CDNCbUSl^N 

An I hdi vidua II zed Multi-media Bilingual Educatioh Magnet Model project 
serve$ limited English prof iciency pupils at one elementary and one secondary, 
school. At the elementary school site the humber of hours of Ehglish Ihstruction 
was increased durihg 1978-1979. The prbpbrtibh of studehts speaklhg languages 
other than Spanish, Koreahj and Portuguese increased substantial ly as a result 
^f_?b^!]9®?_^D_ the composition of the neig around this elementary school. 

^^^^C.I^fJPr.^sp^^ts of the elementary school program were unchanged and conformed 
to the proposal . 

The secondary school program was conducted in a manner consistent with the 
proposal despite strains produced by external events. There was considerable 
mobility of students. The mobility stemmed from two principle causes. A city- 
Wide re-roster ing of secbhdary students resulted In some part Iclpahts ' movihg. 
from project Ehglish classes tb mai inst ream Engl ish classes. A large humber of 
new. Southeast Asian, immigrants in the city resulted Ih the adrtilssioh of many 

studehts to the secondary level pro during the year. One result Was 
over-crowding, which limi ted student acc^ Equipment malfuhctlbns, 

possible student fajlure to ''sign-off' correctly, and limited student access to 
the BIMte made it impossible to demonstrate the value of computer based instruction. 

Three of four enabling objectives of the project were attained or considered 
attaihed. The one enabling objective' hot attained required the developnent of 
Ihfonrial reading ihven tor I es in various languages. The development of Instruct Ibhal 
macerlals has taken precedence over the development of these tests each year of 
the program. 



/i^ ; Examlnatfons of P^Pjt Performance showed that they learned to comprehend 
English more rapidly than their peers in the c|ty-w]de_ESOtproj 
English reading skil Is acquisition was accelerated by participation in' the 
project. Attendance and pupil retention goals also were meti The analysts of 
speaking skills tests did not result in a statistically significant outcomes Due ta 
pupil mobility^ fewer pupils than expected were tested, and evaluatbrs attribute 
the lack of statistical significance In the spefflfing skill area to this source. 
In the past> the rate of acquisition of sjDeakIng skills In this program has been 
similar to the acqulsitidri rate found in the Title J ESOL program. 

In conclusion, the project was effective in accelerating the acquisition bf 

aural comprehension and reading skills. High school attendance and pupil retention 
goals were met. 



TABLE I 

' ANALYSIS OF TEST OF AURAL COMPREHENSION SCORES 



Variables . Weights Signt f f c^nceCp^ 



Test Form - 3.39 . NS 



Birth Place Variables _ 

Puerto Rico -5.37 NS 

Outside USA -5.13 NS 

1.96 NS 

Sex 

Grade Variables 

Grade 1d.4d .61 

Square of Grade -0i98 NS 

Cube of Grade 0.03 NS 

Ungraded Class -1.95 NS 

School Cohtfnalty O.96 NS 

Ma In land Residence (years) -0.25 NS 

Program Exposure 

Months In Program 1.15 .01 

Square of Months In Program -0.02 .01 



Average score = 22.16, R-square = 0.6U Standard Deviation Residuals = 8.69, N =« 144. - 



TABLE 2 



Multiple Reg ress ? on An a 1 y s i s of Read I ng 

Scale Scores on Pupil Background and*^ Program 
Exposure Variables (Fall, 1978) 





Reqresslon Wetqhts — 




VarXab-les 


Word Study-Ski 1 Is 


Reading:^ 


Vocabxilary 


Birth Place 

Puerto Rico 
Outside U.S.A, ' 


-35.33* 
-31.33* 


-35.41*** 
-38. 14*** 


-21. '87* 
-26.00** 1 
1 

5.78* 


Sex 


7.26 


1 .92 


Grade_Var iables 
Grade 

Square of Grade 
Cube of Grade 
Ungraded Class 


27.11** 
-3.66* 

0.17 

4.98 


20.65*** 
-2.. 43* \ 

e.ii \ 

13.75 \ 


13.11** 
-1.94 
e.ii 
-8.53 


School Continuity 


- 1 2 . 62 


-5.00 


-14.03** 


Mainland Residence (years) 


-4.60. 


-4.06** 


-2.00 


Program Exposure 

Months in Program 

Squares of Months in Program 


3.26*^*^ 
-0.07* 


1 .80** 
-0.03 


^ 1.57** 
-0.03 


Average score 
R- Square 

Standard Deviation of Residuals 
Number of Cases 


103.74 
0.60 
23.36 
94 


114.50 
0.78 

14.17 
94 


103.09 
0.72 
12.84 

93 • 


^p^-TDS **p<-01 


***p<.001 







TABLE 3 

Multiple Regression Analysis of Reading 
Scale Scores on Pupil Background and Program 
Exposure Variables (Spring, 1979) 



Variables 



Word StadyLSkJJLls 



Regression Wetgfits 



Read I ng 



Vocabulary 



Birth Place 

Puerto Rico 
Outside U.S.A. 

iSex' 

V;Grade Variables 
Grade 

Square of Grade 
Cube of Grade 
Ungraded Class 

Scliool Continuity 

Ma in land Residence (years) 

Program Exposure 

: Montlis in Prog'-am 
Square of Months in Program 



-18.38 
-24.32 

7.62 



27.31*** 
-2.74 
0.08 
-20.15 

-7.88 

-3.30 



3.09* 
-0.06* 



•12.60 
•15.54 

3.89 



14.43* 
-0.97 
0.02 
-8.61 

-4.79 
-2.36 



2.4b** 
-0.04* 



-27.22** 
-35.10** 

0.23 



1.89 
0.69 
- 0.D4 
-0.86 

-0.33 

-2.33* 



1.47* 
■0.02 



Average Score 
R-Square 

Standard Deviation of Residuals 
Number of Cases 



109.60 
0.60 
20.85 
90 



121.39 
0.70 

15.23 
92 



109.01 
0.68 
12.03 
90 



*p<.05 



p<.01 



''**p<.001 
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